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ABSTRACT 


During the past several years efficient information transmission 
and processing techniques have attracted wide interest and have in- 
creased applicability. The present paper describes a logarithmic en- 
coding device which has had particular application in energetic particle 
detection ejqperiments. The paper provides a generalized encoding 
error analysis in order to evaluate the performance of the device. Both 
peak and average error are derived in terms of word size and desired 
accuracy. The implementation of a flexible logarithmic encoder is also 
described. 
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A LOGARITHMIC ENCODER FOR BINARY 
WORD COMPRESSION 


by 

Joseph A. Sciulli 
Goddard Space Flight Center 


INTRODUCTION 

Growing interest in the development of efficient information transmission techniques is stim- 
ulating much theoretical and experimental work. Particular emphasis has been placed on the 
development of video data compression techniques which exploit the predictability (or redundancy) 
of the data (Reference 1). Many of these techniques are not specifically designed for the video 
information source and can, in principle, be applied to any information source. For example, 
recent experiments have applied a simple predic tor/ encoder compression technique to energetic 
particle experiment data. The experimental data were obtained from a multi-channel device flown 
on the 1963-38C-APL satellite in which each channel was designed to detect particles in a specific 
energy region. Typically, an experiment of this kind requires a rather large word size because 
of the wide range of possible sample values. (The experiment considered used 16 bits per sample.) 
The compression simulations showed that average energy savings of approximately 4 db can be 
achieved with an allowable peak error of approximately 5 percent. 

The main difficulty with such an approach, however, is defining an error criterion which is 
suitable over the entire range of possible sample values. Logarithmic encoding, however, is 
extremely useful in experiments of this type which involve wide dynamic range. The function of 
the encoder is to reduce the number of transmitted bits per sample while maintaining a relatively 
small error in the word reconstructed at the receiver. This paper describes a logarithmic en- 
coding procedure and develops an expression for the error between the original sample value and 
the sample value reconstructed at the receiver. In addition, several design considerations are 
outlined and the operation of the device is discussed briefly. This procedure results in a fixed 
compression, independent of the predictability of the data. Since the bit rate at the output of the 
encoder is constant, there is no need to consider the yet-unsolved buffer queuing problem. 

ENCODING PROCEDURE 

Suppose each sample is originally represented by an n-bit binary word s with components 
(o' n _ 1 , cr n _ 2 , ■••o n _ j , cr n _ ••• o - 0 ). The most significant bit (MSB) is cr n _ l ; cr Q is the least 
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significant bit (LSB); and a n _. is the first component (from the left) which is a 1. We now describe 
an encoder which converts s into two subwords, the characteristic (C) and the mantissa (M) . 

The mantissa is a k-bit word specifying the k MSBs following <x n _ .. The position of cr n _._ k + 1 is 
specified by C , an r-bit word. The encoder output, therefore, consists of ( r + k ) bits where 
(r + k) < n. The operation is best illustrated by an example: 

let n = 19, k = 4, and r = 4 and suppose the input word is S - lOllOOlllOllOOlOllO . 

Here the first 1 appears at the MSB, hence j = l. The 4 bits of M must then consist of the second, 
third, fourth, and fifth MSBs of s (i.e., M = 01 10). The position of the LSB of M must then be 
specified by C. Thus, C = n- k- j+ l = 15or C = 1111. The encoder output is then, 

1111 QUO, 

C M 


Some additional examples are 


Input 

Output 

1111111111111111111 

11111111 

1000000000000000000 

11110000 

0000000000110000000 

01011000 

00000000000000 10000 

00010000 


This example was given by Schaefer (Reference 2). 


The general design problem consists of choosing k and r for some specified n . Since k 
determines how closely the encoded word approximates the input word (n-bits), k should be chosen 
to satisfy the error specification. After k is fixed, r can be chosen to minimize the number of 
bits in the output word. The bit compression ratio n/(r + k) then provides a useful system per- 
formance measure. In the next section error expressions assuming transmission in a noiseless 
channel are developed. 


ENCODING ERROR 

In practice, an experimenter might specify an upper limit on either the average error, the 
maximum error, or both. Here both the average error and the maximum error for the special 
case of equally likely samples are calculated. 

The input word S for some value of j is, by definition, 


2 


E°‘ 21 


According to the encoding rule, the word reconstructed at the receiver must be 


n - j 


s = ^ 21 ■ 
i =n - j - k 


and the error for a given j 


n “ j ~ k “ 1 

E. = S - S = ^ CT i 2 ' ■ 


i =0 

We may now calculate the expected error for a given j according to 


(i) 


( 2 ) 


(3) 


n ~~ j ~ k ~ 1 

E ; = E{E.} = 2] E N 21 ' 

i =0 

If all input words are equally likely, E(<r.) = 1/2 . Therefore, 


(4) 


Ej = T ^ 2i = T t 2n ' j ' k “ *1 ■ (5) 

i =0 

To determine the average error we must average E. over all values of j for which an error can 
occur. That is, 


E 


2^ E j p(i) ; p(i) 


l 

— r for 
2 ' 


= 1, 2, 


(n - k - 1) 


1 

2 n~k-l 


for j = (n - k) 


where E. = o for j = (n - k). Therefore, 


E = 22 T [2 n ' i ’ k - 1] ~ 



Since each term in braces is a geometric series, 


( 6 ) 
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E = 


2 n_k_I 



_ 2“ 2 ( n — k “ 




and, collecting terms, 


(V 


E 


if., 

— on k ~ 1 

3 (_ 2 


+ 2 ~ fn_k) 



( 8 ) 


We can also calculate the maximum error. Returning to Equation 3, the error for a given j is 


E. 

J 


n 


-j-k-1 



cr . 

i 


2 i . 


Now the maximum error must obviously occur for j = l and o-. = l for all i. Therefore, 


n -k- 2 

E = max E. = / 2 1 = [2 n ' k ~ 1 - l] 

max j / t L J 

] i =0 

The average error as a fraction of full scale is 


e f 


2 n “ k ~ 1 2 "( n ~k) 

3 (2 n - l) 



and, for (n - k) » 1 , 


_ ^ 2 n ~ k ~ 1 _ J _ 1 

E f 3(2") ~ 3 2 k + 1 


(9) 


( 10 ) 


(ID 


Similarly, the maximum error as a fraction of full scale is 


E F [max] 


and, again, for (n - k) » l , 


' [max] 


( 12 ) 


(13) 


The appendix lists both E F and E F |- max j for various combinations of n and k. Thus, for a given 
n, a k can be chosen, according to Equations 10 and 12, to satisfy given error requirements. 
After the value of k is established r should be chosen as the smallest integer satisfying 
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(n - k) < 2 r - 1 , 


or 


r > Log 2 (n - k + 1) . 


( 14 ) 


If equality is obtained in Equation 14, then all possible values of C can occur. 


IMPLEMENTATION 


The implementation of this device is quite simple. A generalized system is shown in Figure 1. 
The n-bit input word is presented serially (MSB first) to a k-bit register. The input word is 


shifted until a 1 appears in the kth bit of the 
register. The next clock pulse changes the 
state of the control flip flop, inhibiting the 
shift register and starting the r-bit counter. 
At the nth clock pulse the shift register con- 
tains the k bits of M and the counter contains 
the r bits of C. The contents of the register 
and counter can then be transferred to an out- 
put register. The elements of the encoder are 
then reset, and the device is prepared to re- 
ceive the next input word. 


(k + r) BIT OUTPUT WORD 



CONCLUSIONS 


Figure 1 — Implementation of the encoder. 


This encoding procedure provides a useful device which achieves fixed, but modest, bit com- 
pression. For example, the 16-bit words of the energetic particle experiment could be encoded to 
8 bits ( k - 4, r - 4 ), resulting in a bit compression ratio of 2:1. This gives an average error of 
approximately 1 percent and a maximum error of about 3 percent. Moreover, this device could be 
combined with a zero-order predictor/ run-length encoder to achieve further compression. The 
zero order hold compression might even be applied in the bit planes of c since these should be 
relatively quiescent from sample to sample. 

For a slight increase in complexity, the logarithmic encoder could be made more flexible by 
varying k and r on command from the ground. Thus, the experimenter would have the capability 
of selecting the allowable error in the data depending on the activity of his experiment at a given 
time. 


Goddard Space Flight Center 
National Aeronautics and Space Administration 
Greenbelt, Maryland, August 1, 1967 
160-44-05-14-51 
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Appendix 


Listing of E f and Ep[ max ] for Combinations of n and k 


n 

k 

E f 

E F [max] 

n 

k 

E f 

E F [max] 

2 

1 

0. 

c. 

12 

1 

0.C3323162 

0. 24981684 

3 

1 

0.0357142 8 

0.14285714 

12 

2 

0.04155482 

0. 1 2478632 

3 

2 

0. 

0. 

12 

3 

0.02071647 

C. 06227106 

4 

1 

0. 08833333 

C. 20000000 

12 

4 

0.01029743 

0. 03101343 

4 

2 

0. 0166666 7 

C. 06666666 

12 

5 

0.00506814 

0.01538461 

4 

3 

0. 

0. 

12 

6 

0. 00248397 

0.0075702! 

5 

1 

0.07056452 

0. 22580644 

12 

7 

0.00118284 

0. 00366300 

5 

2 

0.02822580 

0.09677419 

12 

8 

0. 0005341 8 

0. 00170940 

5 

1 

0.00806452 

0.03225806 

12 

9 

0.00021 36 8 

0.00073260 

5 

4 

0. 

0. 

12 

1 0 

0.0000610 5 

0.00024420 

6 

1 

0. 07688492 

0. 23809523 

1? 

11 

0. 

0. 

6 

2 

0. 03472222 

C . 1 1 1 1 1 1 1 0 

13 

1 

0. C832824 7 

0. 24990843 

6 

2 

0. 01388889 

0. 04761904 

13 

2 

0.04161073 

0. 12489317 

6 

4 

0.00396825 

0. 01587301. 

13 

3 

0.02077487 

0.06238554 

6 

5 

0. 

0. 

1 3 

4 

0.01 035697 

0.03113173 

7 

1 

0. 08009350 

0. 24409448 

1 3 

5 

0.00514808 

0.01550482 

7 

2 

0.03813976 

0. 11811023 

1 ^ 

6 

0.00254375 

0.00769137 

7 

2 

0.01722441 

0. 05511811 

13 

7 

0.00124! 83 

0. 0C378464 

7 

4 

0. 00688976 

0. 02362204 

1 3 

8 

0.0005913 5 

0.00183128 

7 

5 

0.00196850 

C. 00787401 






6 

0 . 

0 • 

13 

9 

0.0002670 6 

0. 00085460 

8 

1 

0. C81 70956 

C. 24705882 

13 

1 0 

0.00010682 

0.00036626 

8 

2 

0. 0 398897 0 

C. 12156862 

13 

11 

0.00003052 

0. 00012209 

8 

2 

0. 01 899509 

0. 05882353 

13 

1 2 

0 • 

0 . 

8 

4 

0.00857843 

0. 02745098 

14 

1 

0. 08330790 

0.24995422 

8 

5 

0.00343137 

0. 01176471 

14 

2 

0.041 63 86 9 

0. 12494659 

a 

6 

0. C009803 9 

0.00392157 

14 

3 

0.02080409 

0.06244277 

a 

7 

0 . 


14 

4 

0.0107 8 68 0 

0. 0311 9036 

n 

9 

1 

0. 0 8252048 

u . 

0. 24853229 

14 

5 

0.00517817 

0. 01556491 

9 

2 

0.04077482 

0.12328767 

14 

6 

0.00257389 

0.00775193 

V 

2 

0. Cl 99058 2 

0. 06066536 

14 

7 

0.00! 271 80 

0.00384545 

9 

4 

0. 00947896 

0. 02935421 

14 

8 

0.0006208 8 

C. 00189220 

9 

8 

0.00428082 

0. 01369863 

14 

9 

0.00029565 

0.00091553 

9 

8 

0.00171232 

0.00587034 

14 

to 

0.00013352 

0.00042727 

9 

7 

0.0004892 3 

0.00195695 

14 

11 

0. 00005341 

0.00018311 

9 

8 

0. 

0. 

14 

12 

0.0000152 6 

0.00006104 

1 0 

1 

0.0829266 7 

0. 24926686 

14 

13 

0. 

0. 

10 

2 

0.04121991 

0. 1 241 4467 

15 

1 

0.08332061 

0. 24997710 

10 

2 

0.0203674 8 

0. 06158357 

15 

2 

0. 0416526 8 

0.12497329 

10 

4 

0.0099431 8 

0. 03030302 

15 

3 

0.02081 87! 

0.06247138 

10 

8 

0.00473484 

0.01466275 

1 5 

4- 

0. 01040173 

0.03122043 

10 

6 

0.00213832 

0.00684261 

15 

6 

0.00519324 

0.01559495 

10 

7 

0. 0008553 3 

0. 00293255 

15 

6 

0. 00258900 

0.00778221 

10 

8 

0.0002443 8 

0.00097752 

1 5 

7 

C.C01 28690 

0.00387584 

10 

9 

0. 

0. 

1 5 

8 

0. 00063 58 8 

0.00192266 

11 

1 

0. C831299 4 

0. 24963360 

15 

9 

0.00031043 

0.00096-607 

11 

2 

0.04144308 

0.12457254 

1 5 

10 

0.0001 478? 

0.00045777 

11 

2 

0.02059989 

0.0620^201 

15 

11 

0.00006676 

0.00021362 

11 

4 

0.0’ 017877 

0.03077674 

1 5 

12 

0.00002670 

0. 000C91 55 

11 

8 

0 . C049691 6 

0.01514411 

15 

13 

0.00000763 

0. 00003052 

11 

6 

0.0023662 7 

0.00732730 

1 5 

1 4 

0. 

0 . 

11 

7 

0. 00106864 

0. 00341964 





11 

8 

0.00042745 

0.00146556 





11 

9 

0.0001221 3 

0.0004835? 





3 1 

10 

0. 

0. 






7 



n 

k 

E f 

E F [max] 

n 

k 

E f 

E F [max] 

1 6 

1 

C.C8332697 

0. 24998855 

19 

1 

0. 08333253 

.0.24999356 

16 

7 

0. 04165967 

0.12498664 

1.9 

2 

0.04166579 

0. 12499832 

1 6 

7 

0.07082602 

0.06248559 

19 

3 

0.02083241 

0.06249820 

16 

4 

0.0104091 9 

0.03123521 

19 

4 

0.01041 573 

0.03124314 

16 

8 

0.00520078 

0.01560997 

19 

5 

0.005207? 3 

0.01562312 

16 

6 

0.0025965 8 

0.00779735 

19 

6 

0.00260322 

0. 00781060 

16 

7 

0.00129448 

0.00389104 

19 

7 

0. 001 3011 3 

0.00390434 

16 

8 

0.00064344 

0.00193789 

19 

8 

0.00065009 

0.00195122 

16 

9 

0.00031793 

0.00096131 

19 

9 

0.00032^56 

0.00097466 

16 

10 

0. 00015 52 1 

0.00047302 

19 

10 

0.00016180 

0. 00048637 

16 

11 

0.00007391 

0. COO 22883 

19 

11 

0. 00008043 

0. 00024223 

i 6 

12 

0. 0000333 8 

0.00010681 

i 9 

1.2 

0.00003974 

0.00012016 

16 

13 

0.00003 33 5 

0. 00004578 

19 

13 

0.00001940 

0. 0000591.3 

16 

1 4 

0. 00000381 

0.00001526 

19 

14 

0. 00000924 

0.00002361 

16 

13 

0. 

0. 

19 

1 5 

0. 0000041 7 

0. 00001335 

1 7 

1 

0.0833301 5 

0. 24999427 

19 

1 6 

0.00000167 

0.00000572 

17 

2 

0.0416631 6 

0.1 2499332 

19 

1 7 

0.00000048 

0.00000191 

17 

3 

0.0208296 7 

0. 06249284 

19 

18 

0. 

0. 

17 

4 

0. 01041 293 

0.03124263 

20 

1 

0. 08333293 

0.24999928 

17 

3 

0.00570456 

0.01561748 

20 

2 

0. C4166622 

0. 12499916 

17 

6 

0.0026003 7 

0.00780492 

20 

3 

0. 020832B 7 

0. 06249910 

17 

7 

0.0012982 8 

0. 00389854 

20 

4 

0. 01 04] 61 9 

0.03124907 

17 

8 

0.00064723 

0.00194550 

20 

5 

0.00520186 

0.01562405 

17 

9 

0.00032172 

0. 00096893 

20 

6 

0. 00260369 

0. 00781155 

17 

10 

0.00015897 

0.00048065 

20 

7 

0.001 30160 

0.00390530 

17 

11 

0. 00007761 

0.00023651 

20 

8 

0. 00065056 

0.00195217 

17 

12 

0.00003695 

0.0001 1444 

20 

9 

0.00032504 

0.00097561 

17 

13 

0.00001 66 9 

0. 00005341 

20 

1 0 

0. 000162? 8 

0. 0 <1043733 

17 

14 

0.00000668 

0.00002289 

20 

11 

0. 00008090 

0.00024319 

17 

13 

0. 00000191 

0.00000763 

20 

12 

0.0000402 1 

0. 0001 2112 

17 

1 6 

0. 

0. 

20 

13 

0.00001 987 

0.00006003 

in 

1 

0.08333174 

0. 24999713 

20 

14 

C. 00000970 

0. 00002956 

in 

2 

0.04166491 

0. 12499665 

20 

1 5 

0.0000046? 

0. 00001431 

in 

3 

0.02083150 

0.06249642 

20 

16 

0.00000209 

0. 00000668 

18 

4 

0.01 041 479 

0.03124630 

20 

17 

0.00000083 

0. 000C0286 

1 8 

5 

0.00520644 

0. 01562124 

20 

1 8 

0.00000024 

0. 00000095 

18 

6 

0. 0026027 6 

0.00780371 

20 

19 

0. 

0. 

1 8 

7 

0. 001 3001 8 

0. 00390244 





18 

8 

0.0006491 3 

0. 00194931 





18 

9 

0.00032362 

0.00097275 





18 

1 0 

0.00016086 

0.00048447 





18 

11 

0.00007948 

0.00024033 





18 

12 

0.00003880 

0.00011826 





18 

13 

0.0000184 3 

0.00005722 





18 

14 

0. 0000083 4 

0.00002670 





18 

15 

0.00000334 

0.000 01144 





18 

16 

0. 0000009 5 

0. 00000331 





1 8 

17 

0. 

0. 
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